Bayesian optimization of hyperparameters from noisy marginal likelihood estimates
نویسندگان
چکیده
Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. optimization is an iterative method where Gaussian process posterior underlying function sequentially updated new evaluations. We propose novel framework for situations user controls computational effort and therefore precision This common in econometrics likelihood computed Markov chain Monte Carlo or importance sampling methods. The acquisition strategy gives optimizer option to explore with cheap noisy evaluations find optimum faster. applied estimating prior two popular on US macroeconomic time series data: steady-state vector autoregressive (BVAR) time-varying parameter BVAR stochastic volatility.
منابع مشابه
Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasets
Bayesian optimization has become a successful tool for hyperparameter optimization of machine learning algorithms, such as support vector machines or deep neural networks. Despite its success, for large datasets, training and validating a single configuration often takes hours, days, or even weeks, which limits the achievable performance. To accelerate hyperparameter optimization, we propose a ...
متن کاملTowards an Empirical Foundation for Assessing Bayesian Optimization of Hyperparameters
Progress in practical Bayesian optimization is hampered by the fact that the only available standard benchmarks are artificial test functions that are not representative of practical applications. To alleviate this problem, we introduce a library of benchmarks from the prominent application of hyperparameter optimization and use it to compare Spearmint, TPE, and SMAC, three recent Bayesian opti...
متن کاملUsing Meta-Learning to Initialize Bayesian Optimization of Hyperparameters
Model selection and hyperparameter optimization is crucial in applying machine learning to a novel dataset. Recently, a subcommunity of machine learning has focused on solving this problem with Sequential Model-based Bayesian Optimization (SMBO), demonstrating substantial successes in many applications. However, for expensive algorithms the computational overhead of hyperparameter optimization ...
متن کاملEfcient Marginal Likelihood Optimization in Blind Deconvolution
In blind deconvolution one aims to estimate from an input blurred image y a sharp image x and an unknown blur kernel k. Recent research shows that a key to success is to consider the overall shape of the posterior distribution p(x, k|y) and not only its mode. This leads to a distinction between MAPx,k strategies which estimate the mode pair x, k and often lead to undesired results, and MAPk str...
متن کاملComparison of Estimates Using Record Statistics from Lomax Model: Bayesian and Non Bayesian Approaches
This paper address the problem of Bayesian estimation of the parameters, reliability and hazard function in the context of record statistics values from the two-parameter Lomax distribution. The ML and the Bayes estimates based on records are derived for the two unknown parameters and the survival time parameters, reliability and hazard functions. The Bayes estimates are obtained based on conju...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Applied Econometrics
سال: 2023
ISSN: ['1099-1255', '0883-7252']
DOI: https://doi.org/10.1002/jae.2961